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ABSTRACT 

A  framework  is  proposed  for  adaptive  signal  processing  that 
combines  classical  signal  processing  with  adaptation  criteria  in¬ 
volving  interpretation  of  the  output  signal  and  qualitative  infor¬ 
mation  about  the  classical  signal  processing  itself.  Interpreta¬ 
tion  of  the  output  signal  is  achieved  by  expressing  the  signal  at 
multiple  levels  of  abstraction,  capturing  different  levels  of  signal 
detail.  A  key  aspect  of  the  proposed  framework  is  the  computa¬ 
tion  of  rich  error  descriptions  by  matching  signal  abstractions, 
as  opposed  to  correlating  numeric  signals.  Another  key  aspect 
is  the  encoding  of  qualitative  information  about  the  behavior  of 
the  classical  signal  processing  component  as  processes  that  act 
upon  reference  signal  abstractions  and  produce  output  signal 
abstractions.  A  search  is  then  conducted  for  the  most  plausi¬ 
ble  processes  that  explain  the  differences  between  the  reference 
output  and  the  actual  output  of  the  system. 

1.  INTRODUCTION 

A  major  component  of  real-world  signal  processing  is  adaptation 
of  signal  processing  parameters  according  to  the  situation  at 
hand.  A  single  setting  of  the  parameters  of  a  signal  processing 
system  is  often  inadequate,  and  will  cause  the  system  to  fail,  if 
the  input  signal  violates  too  drastically  the  assumptions  behind 
the  design  of  the  system.  Adaptation  of  a  single  stage  signal 
processing  system  can  be  achieved  by  adjusting  its  parameters 
according  to  the  deviation  of  the  output  from  an  ideal  output. 
In  the  case  of  a  multistage  system,  parameter  adjustment  must 
be  preceded  by  identification  of  the  stages  responsible  for  the 
system  failure.  In  this  paper  we  propose  a  novel  framework 
for  adaptive  multistage  signal  processing  that  combines  classical 
signal  processing  with  interpretation  and  diagnosis  [12j.  Signal 
abstraction  (8,9]  is  the  backbone  of  both  the  interpretation  and 
the  diagnosis  components. 

Signal  interpretation  in  our  context  analyzes  the  output  signal 
to  determine  whether  the  result  is  satisfactory  for  the  problem  at 
hand.  For  example,  if  we  analyze  periodic  signals  and  the  output 
is  a  spectrum,  a  satisfactory  result  is  a  line  spectrum.  A  related 
question  is  that  of  optimality:  is  the  result  the  best  that  can 
be  obtained?  For  example  in  the  periodic  signal  case,  we  want 
to  obtain  the  sharpest  spectral  peaks  possible.  We  purposefully 
distinguish  between  a  satisfactory  and  an  optimal  result,  because 
we  feel  that  optimality  may  be  very  difficult  to  define,  unless 
in  restricted  cases,  whereas  criteria  for  a  satisfactory  but  not 
necessarily  optimal  result  may  be  easier  to  obtain. 


Diagnosis  in  adaptive  signal  processing  is  reduced  to  search  for 
the  causes  of  any  deviation  of  the  output  signal  from  the  criteria 
that  determine  what  is  a  satisfactory  result.  For  example,  if  the 
spectrum  of  a  presumably  periodic  signal  is  not  a  line  spectrum, 
the  goal  of  diagnosis  is  to  track  the  cause  of  this  discrepancy 
either  to  a  parameter  misadjustment  of  the  spectrum  estimation 
algorithm  or  to  a  violation  of  the  periodic  signal  assumption.  In 
the  case  of  a  single  stage  system,  such  as  a  spectral  estimation 
algorithm,  the  diagnosis  problem  may  be  fairly  straightforward, 
in  that  there  are  very  few  parameters  that  can  be  misadjusted. 
Diagnosis  becomes  more  challenging  in  the  case  of  multistage 
systems,  such  as  the  one  described  in  [12],  which  have  several  sets 
of  parameters  associated  with  interacting  stages,  and  therefore 
deciding  which  parameters  are  misadjusted  and  why  becomes  a 
search  problem  [5]. 

In  section  2  we  review  adaptive  signal  processing  and  we  place 
subsequent  discussion  in  the  context  of  generalizing  the  classi¬ 
cal  adaptive  signal  processing  paradigm.  In  section  3  we  define 
diagnosis  as  a  search  problem.  The  question  of  how  to  obtain 
the  initial  and  goal  states  associated  with  the  resulting  search 
problem  is  addressed  by  signal  interpretation,  the  role  of  which 
is  examined  in  section  4.  Finally,  section  5  is  a  conceptual  de¬ 
sign  of  an  adaptive  signal  processing  framework  that  integrates 
diagnosis  and  signal  interpretation. 


2.  ADAPTIVE  SIGNAL  PROCESSING 


Adaptive  Signal  Processing  has  been  extensively  investigated, 
primarily  in  the  context  of  adaptive  filtering  (4,2,3).  The  block 
structure  of  an  adaptive  signal  processing  system  is  shown  in  Fig¬ 
ure  1.  The  Signal  Processing  System  is  commonly  a  linear  filter 
specified  by  a  number  of  weights,  the  filter  parameters.  Exam¬ 
ples  of  programmable  filters  are  tapped-delay  lines  (transversal 
filters)  or  state-space  matrices  (Kalman  filters).  The  Error  Es¬ 
timate  is  usually  a  numeric  measure  of  the  distance  between  the 
output  signal  and  the  reference  signal.  The  Adaptation  Algo¬ 
rithm  specifies  an  incremental  change  to  the  system  parameters 
as  a  function  of  the  error  estimate.  The  large  number  of  adap¬ 
tive  signal  processing  techniques  found  in  the  literature  is  mainly 
due  to  the  large  number  of  possible  adaptation  algorithms.  A 
common  characteristic  of  most  adaptation  algorithms  is  that  the 
new  set  of  parameters  is  obtained  from  the  old  set  of  parameters 
multiplied  by  an  “innovations"  matrix.  In  this  paper,  we  retain 
the  basic  structure  shown  in  Figure  1,  but  we  propose  a  more 
general  view  of  the  signal  processing  system,  error  estimation 
and  adaptation  algorithm. 
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Concerning  the  signal  processing  system,  we  include  any  kind  of 
signal  processing,  not  only  linear  filter  structures.  Furthermore, 
we  include  both  single  stage  and  multistage  systems.  Signal 
Processing  systems  in  real  applications  are  usually  Multistage 
systems,  namely  they  are  built  out  of  a  sequence  of  stages,  each 
of  which  has  a  concise  mathematical  description.  The  classical 
adaptation  scheme  mentioned  above  has  been  applied  primar¬ 
ily  to  single-stage  systems,  which  give  rise  to  mathematically 
amenable  optimization  problems,  solved  by  mathematical  opti¬ 
mization  techniques  [7].  In  multistage  signal  processing  systems, 
the  connection  between  the  parameters  of  a  particular  stage  and 
the  output  signal  becomes  less  direct,  and  therefore  the  adap¬ 
tation  process  becomes  much  more  difficult,  because  it  involves 
identifying  the  stage  or  stages  that  need  to  be  adapted,  in  addi¬ 
tion  to  parameter  adaptation  itself. 

Concerning  the  error  estimate,  we  view  it  as  the  bottleneck  in 
current  adaptive  filters:  all  the  information  about  the  difference 
between  the  output  signal  and  the  reference  signal  (or  criteria) 
must  be  expressed  in  terms  of  a  single  numeric  error  measure. 
We  propose  that  the  error  estimate  be  a  symbolic  description 
of  the  differences  between  the  actual  and  the  desired  filter  out¬ 
put.  Computation  of  the  error  estimate  is  thus  viewed  as  signal 
matching,  which  can  be  conveniently  approached  via  signal  ab¬ 
stractions  [8,9],  i.e.  condensed  descriptions  of  signal  features 
and  their  groupings  at  multiple  levels  of  detail.  Other  relevant 
approaches  include  waveform  matching  by  tree  correlation  [Ij, 
by  feature  correlation  [13],  or  using  a  scale-space  representation 
[14]. 

In  many  cases,  a  reference  input  is  lacking,  but  criteria  are  avail¬ 
able  related  to  the  acceptability  of  the  filter  output.  For  exam¬ 
ple,  we  filter  a  noisy  image  in  order  to  enhance  it.  It  is  usually 
not  easy  to  measure  the  amount  of  noise  present  in  an  image,  so 
that  we  can  tell  whether  filtering  ofTers  any  improvement  or  not. 
Usually,  some  aspects  of  the  image  improve  (e.g.  background 
noise  gets  smoothed)  and  other  aspects  worsen  (e.g.  edges  be¬ 
come  blurred).  Although  it  is  difficult  to  define  a  quantitative 
measure  of  the  amount  of  noise  in  the  image,  we  can  describe 
the  characteristics  of  a  “good"  image,  for  example  sharp  edges 
and  clean  background.  Given  these  criteria,  we  can  compare  en¬ 
hanced  images  obtained  with  different  filter  parameter  settings, 
order  them  according  to  our  criterion  and  select  the  parameter 
setting  that  gives  a  satisfactorily  enhanced  image.  In  this  case, 
denoted  by  “reference  criteria"  in  Figure  1,  the  error  estimate  is 
a  description  of  whether  adaptation  so  far  has  brought  us  closer 
to  the  satisfaction  of  the  reference  criteria.  A  similar  approach 
was  used  in  [8,9]  for  adjusting  spectral  estimation  parameters. 

3.  DIAGNOSIS 

A  diagnostic  problem  starts  with  the  observation  of  some  be¬ 
havior  that  is  recognized  as  a  deviation  from  the  expected.  Di¬ 
agnosis  is  the  process  of  determining  the  cause  of  such  deviation 
[11].  As  a  component  of  adaptive  signal  processing,  diagnosis  is 
the  process  of  determining  why  the  output  of  a  signal  processing 
system  deviates  from  our  expectations.  In  the  case  of  classical 
adaptive  signal  processing,  the  deviation  of  the  output  signal 
from  the  reference  signal  is  attributed  to  inappropriate  values  of 
the  elements  of  a  vector  quantity,  such  as  the  filter  coefficient 
vector.  No  finer  grain  explanation  is  sought,  and  the  adjust¬ 
ment  of  system  parameters  is  performed  using  an  mathematical 
optimization  approach.  Therefore  the  diagnosis  problem  is  not 
addressed  explicitly,  because  the  causes  of  system  misbehavior 


cannot  be  traced  to  individual  system  parameters.  However, 
in  the  case  of  multistage  signal  processing  systems,  the  number 
of  parameters  is  large.  Furthermore,  different  parameters  are 
associated  with  different  aspects  of  the  signal  processing  sys¬ 
tem,  and  therefore  parameters  cannot  be  grouped  together  and 
treated  as  a  vector  quantity.  The  task  of  diagnosis  then  becomes 
to  associate  system  misbehavior  to  specific  parameters  of  indi¬ 
vidual  stages,  so  that  the  adaptation  problem  is  simplified  by 
being  reduced  to  adjustment  of  a  small  number  of  misadjusted 
parameters. 

The  mathematical  theory  underlying  multistage  signal  process¬ 
ing  systems  can  be  used  to  facilitate  the  diagnostic  task.  Unlike 
other  diagnostic  tasks,  e.g.  medical  diagnosis,  signal  processing 
systems  generate  enormous  amounts  of  intermediate  data,  and 
therefore  production  rules  that  map  symptoms  of  system  misbe¬ 
havior  to  possible  faults  would  be  overwhelmed.  The  underlying 
mathematical  theory  can  be  used  to  define  processes  that  trans¬ 
form  the  reference  or  ideal  output  into  the  actual  output  signal. 
Each  process  is  specified  in  terms  of  how  it  transforms  its  in¬ 
put,  and  it  is  fully  characterized  by  a  set  of  parameters,  that  are 
directly  associated  with  actual  system  parameters. 

In  the  case  of  no  fault,  the  reference  output  is  identical  to  the 
system  output,  and  therefore  each  process  acts  as  an  identity 
transformation.  In  the  case  of  faulty  behavior,  one  or  more  of 
the  processes  are  non-identity  transformations,  and  diagnosis 
becomes  search  for  the  non-identity  processes.  This  formulation 
has  been  used  as  the  basis  of  an  implemented  framework  for  diag¬ 
nosis  as  search  [12].  In  formulating  a  problem  as  search,  we  must 
first  define  the  problem  space,  which  consists  of  a  set  of  states 
of  the  problem,  and  a  set  of  operators  that  change  the  state  of 
the  problem,  or,  equivalently,  arc  mappings  between  states  [5). 
An  operator  may  have  preconditions  associated  with  it  that  de¬ 
termine  which  states  it  can  be  applied  to.  A  problem  instance 
includes  a  problem  space,  and  an  initial  and  goal  state,  and  the 
task  is  to  find  a  sequence  of  operators  that  change  the  initial 
to  the  goal  state.  The  goal  state  does  not  have  to  be  explicitly 
specified.  Instead,  it  can  be  specified  as  a  set  of  conditions  (goal 
conditions).  In  [12],  the  states  of  the  problem  are  signals  at  mul¬ 
tiple  levels  of  abstraction,  and  operators  correspond  to  processes 
defined  on  the  basis  of  the  underlying  mathematical  theory. 

The  search  strategy  used  in  the  above  framework  is  means-ends 
analysis  at  multiple  levels  of  abstraction.  Means-ends  analysis 
consists  of  matching  the  initial  with  the  goal  state  and  selecting 
a  process  that  can  explain  some  of  the  differences.  In  general, 
the  selected  process  is  not  quite  applicable  to  the  initial  state, 
therefore  a  subproblem  is  created,  how  to  transform  the  ini¬ 
tial  state  into  another  state  that  satisfies  the  preconditions  of 
the  process.  Furthermore,  the  output  of  the  process  is  not  ex¬ 
actly  the  same  as  the  goal  state,  therefore  another  subproblem 
is  present,  namely  transforming  the  output  of  process  into  the 
goal  state.  If  the  process  is  selected  properly,  the  resulting  sub¬ 
problems  are  easier  to  solve  than  the  original  problem.  The  two 
subproblems  are  also  attacked  by  means-ends  analysis. 

In  the  diagnosis  associated  with  adaptive  signal  processing,  in- 
termediate  signal  data  is  usually  enormous  and  often  unavail¬ 
able.  Therefore,  it  is  not  easy  to  verify  the  intermediate  signal 
states  generated  by  the  means-ends  analysis  strategy.  To  rem¬ 
edy  this  problem,  means-ends  analysis  is  augmented  by  a  verifi¬ 
cation  stage,  which  takes  place  at  the  lowest  level  of  abstraction. 
If  the  sequence  of  processes  computed  by  means-ends  analysis 
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at  the  highest  level  of  abstraction  fails  to  be  verified  at  the  low¬ 
est  level  of  abstraction,  then  means-ends  analysis  is  repeated 
at  an  intermediate  level  of  abstraction.  The  verification  stage 
is  an  important  characteristic  of  the  diagnostic  framework,  and 
it  is  made  possible  by  the  existence  of  a  mathematical  theory 
describing  the  associated  signal  processing  system.  Full  details 
of  the  framework  and  its  application  to  diagnosis  of  an  acoustic 
signal  processing  system  are  presented  in  [12]. 

To  apply  the  above  framework  to  the  diagnosis  of  other  multi¬ 
stage  signal  processing  systems,  we  need  to  identify  the  nature 
of  our  expectations  about  the  output  of  the  signal  processing 
system,  their  representation,  and  how  they  arc  obtained.  In  [12) 
expectations  about  the  output  of  the  signal  processing  system 
have  the  form  of  an  abstract  representation  of  the  “correct”  or 
reference  signal  interpretation.  How  such  a  representation  is 
obtained  can  vary.  In  test  situations,  a  reference  signal  inter¬ 
pretation  is  available  because  information  about  the  underlying 
physical  event  is  available  a  priori.  In  operational  use  of  a  sys¬ 
tem,  the  reference  signal  can  be  the  result  of  less  accurate  but 
more  robust  signal  processing,  that  is  capable  of  producing  ab¬ 
stract  signal  interpretations,  but  lacks  the  accuracy  that  the 
complex  system  emi  provide,  if  properly  adapted.  As  in  the 
case  of  general  search,  the  reference  signal  may  not  be  explicitly 
available,  but  described  as  a  set  of  criteria  or  properties  that  the 
output  signal  must  satisfy. 

4.  SIGNAL  INTERPRETATION  AND  MATCHING 

An  important  input  to  the  diagnosis  engine  is  a  reference  sig¬ 
nal  interpretation  and  the  actual  output  signal  interpretation  of 
the  signal  processing  system.  In  a  real  application,  these  are 
not  available,  as  it  was  assumed  in  [12],  but  they  have  to  be 
extracted  as  signal  abstractions  from  low-level  signals.  Deriving 
signal  interpretations  from  low-level  numeric  signals  is  therefore 
a  major  component  of  adaptive  signal  processing  based  on  di¬ 
agnosis.  In  classical  adaptive  signal  processing,  the  need  for 
signal  interpretation  is  obviated  by  a  direct  computation  of  the 
error  as  a  numeric  correlation  between  the  system  output  and 
the  reference  signal.  In  adaptive  signal  processing  based  on  di¬ 
agnosis,  the  error  computation  is  performed  in  two  steps.  The 
first  is  computation  of  signal  abstractions  of  the  system  output 
and  the  reference  signal,  and  the  second  is  their  matching  and 
computation  of  an  abstract  description  of  their  differences.  The 
latter  is  also  a  component  of  the  diagnostic  framework  that  uses 
means-ends  analysis. 

Computation  of  signal  abstractions  was  addressed  in  [8,9].  In 
the  context  of  diagnosis,  signal  abstractions  correspond  to  search 
states  and  therefore  we  can  draw  a  parallel  between  a  general 
theory  of  abstractions  [5]  and  the  formulation  proposed  in  [8,9]. 
In  [5],  two  models  of  abstraction  in  search  are  proposed.  In  the 
first,  the  set  of  abstract  state*  is  a  subset  of  the  states  in  the 
original  problem  space.  In  the  second,  each  state  of  the  abstract 
space  corresponds  to  a  subset  of  the  states  in  the  base  space. 
The  formulation  of  signal  abstraction  in  [8,9]  is  equivalent  to 
the  second,  more  general  model. 

The  problem  of  deriving  the  abstract  states  given  the  base  states, 
which  correspond  to  the  numeric  signal,  has  also  been  addressed 
[8,9],  It  involves  a  grouping  process,  the  ingredients  of  which 
are  formally  defined.  An  implementation  is  also  provided  in  the 
context  of  a  specific  application,  tracking  of  harmonic  signals 
over  time.  The  grouping  framework  proposed  is  quite  general, 


but  the  choice  of  specific  abstractions  depends  on  the  signal 
processing  problem  under  consideration.  So  far,  we  have  defined 
abstractions  for  three  distinct  problems  [12,  9,  6]  and  we  have 
implemented  computationally  the  two  of  them  [9,  6], 

Computing  signal  abstractions  is  the  first  step  towards  obtaining 
a  description  of  the  error  between  the  reference  signal  and  the 
output  signal.  In  diagnosis  based  on  means-ends  analysis,  the 
error  should  be  a  rich  enough  description  of  the  differences  be¬ 
tween  the  reference  and  output  signal  to  enable  selection  of  the 
appropriate  process  or  operator.  A  single  numeric  error  mea¬ 
sure,  as  the  one  produced  by  numeric  correlation  of  two  signals, 
is  usually  not  rich  enough  to  permit  operator  selection.  In  the 
example  presented  in  [12],  differences  between  signals  are  com¬ 
puted  from  their  abstract  descriptions  and  they  are  related  to 
several  of  their  aspects,  such  as  high-power  spatial  frequencies  or 
and  the  associated  bandwidths.  In  matching  harmonic  acoustic 
signals  [9],  the  differences  between  two  spectra  refer  to  the  dif¬ 
ferent  numbers  of  harmonic  present  and  the  relative  sharpness 
of  the  respective  spectral  peaks. 

Matching  a  signal  against  criteria  can  also  arise  in  adaptive  sig¬ 
nal  processing,  when  the  reference  signal  is  not  given  explicitly, 
but  is  described  as  a  set  of  conditions.  For  example,  in  the  com¬ 
putation  of  harmonic  spectra,  the  goal  condition  is  a  spectrum 
with  maximally  sharp  harmonic  peaks.  A  goal  state  specified  by 
conditions  may  occur  in  subproblcms  arising  during  means-ends 
analysis.  In  this  case,  we  need  to  find  the  differences  between 
the  initial  state  and  the  preconditions  of  the  operator.  In  [12], 
such  differences  are  computed  within  the  same  framework  as 
matching  two  explicit  abstract  signal  descriptions. 

5.  CLOSED-LOOP  OPERATION 

Diagnosis  and  interpretation  are  two  of  the  three  components 
of  a  closed-loop  framework  for  adaptive  signal  processing.  The 
third  component  is  adaptation  of  system  parameters  based  on 
the  diagnosis  outcome.  The  framework  shown  in  Figure  2  can  be 
viewed  as  a  generalization  of  classical  adaptive  signal  process¬ 
ing.  Classical  adaptive  signal  processing  mostly  applies  to  single 
stage  systems  and  therefore  its  diagnosis  component  is  very  sim¬ 
ple.  Furthermore,  the  process  of  finding  the  differences  between 
the  actual  output  signal  and  the  reference  signal  takes  place 
at  the  lowest  level  of  abstraction,  the  numeric  signal,  with  the 
resulting  difference  being  an  numeric  error  measure.  Therefore, 
the  proposed  framework  includes  two  generalizations  of  the  clas¬ 
sical  adaptive  approach.  The  first  is  along  the  signal  representa¬ 
tion  dimension  and  introduces  signal  abstraction  as  a  means  of 
using  conceptual  clusters  of  signal  points  in  the  difference/error 
finding  process.  The  second  is  along  the  complexity  of  the  un¬ 
derlying  signal  processing  system,  and  introduces  diagnosis  as 
search  for  its  misadjusted  parameters,  which  is  applicable  to 
multistage  signal  processing  systems. 

6.  DISCUSSION 

In  this  paper  we  reviewed  the  formulation  of  adaptive  signal  pro¬ 
cessing  as  a  problem  that  involves  diagnosis,  signal  interpreta¬ 
tion  and  qualitative  reasoning  about  signal  processing  systems. 
Parts  of  the  proposed  framework  have  already  been  explored 
in  the  context  of  specific  problems  with  promising  results.  Al¬ 
though  a  lot  of  work  remains  to  be  done  in  terms  of  validation  of 
the  proposed  framework  and  its  formalization,  we  believe  that 
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there  is  enough  evidence  at  this  point  to  suggest  that  diagnosis 
and  signal  interpretation  can  play  an  important  role  in  extending 
the  spectrum  of  available  adaptive  signal  processing  tcchni<|ucs 
and  methodologies. 
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Figure  1:  Classical  Adaptive  Signal  Processing. 
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Figure  2:  Adaptive  Signal  Processing  using  Interpretation  and 
Diagnosis 


DISTRIBUTION  LIST 


DODAAD  Code 


Director  HX1241  (l) 

Defense  Advanced  Research  Project  Agency 

1400  Wilson  Boulevard 

Arlington,  Virginia  22209 

Attn:  Program  Management 


Head  Mathematical  Sciences  Division  N00014  (1) 

Office  of  Naval  Research 
800  North  Quincy  Street 
Arlington,  Virginia  22217 


Administrative  Contracting  Officer  N66017  (1) 

E19-628 

Massachusetts  Institute  of  Technology 
Cambridge,  Massachusetts  02139 


Director  N0017  3  (6) 

Naval  Research  Laboratory 
Attn:  Code  2627 
Washington,  D.  C.  20375 


Defense  Technical  Information  Center  S47031  (  2) 

Bldg  5,  Cameron  Station 
Alexandria,  Virginia  22314 


Dr.  Judith  Daly  (1) 

DARPA  /  TTO 

1400  Wilson  Boulevard 

Arlington,  Virginia  22209 


